An Api for Transparent Distributed Vertical Data Mining

New data mining tools and algorithms are available for vertical data mining communities for scalable and efficient data mining to discover the hidden nuggets from huge repositories of data. Most of the traditional data mining algorithms do not scale on these huge datasets. This is due to insufficient computational resources, currently available on a single machine for running these applications. Distributed computing based in a vertical data structure presents an effective solution for dealing with the computational load incurred in data mining applications. However, currently there exists no such API for a vertical data structure on a distributed environment. As a result an API for a distributed vertical data mining is necessary for steering the future development of data mining algorithms to provide further scalability for large datasets. In this paper we present an API for a distributed vertical data mining environment providing different levels of transparency and flexibility using MPI as a distributed computing environment and C++ as a programming language.